Hybrid dental imaging system with local area network and cloud

ABSTRACT

Methods and systems for storing and accessing dental images. The system includes an imaging system for acquiring x-ray projection frames. The imaging system is connected to a local server through a local area network. A cloud server communicates with devices on the local area. The x-ray projection frames are transmitted from the imaging system to the local server. The local server stores the series of related x-ray projection frames according to a specified policy. In one embodiment, the x-ray projection frames are compressed into a compressed image data set using a modified video compression prediction algorithm customized for x-ray images. The x-ray image data (whether compressed or not) is transmitted to the cloud server for storage. The x-ray image data can be accessed from the cloud server by external devices and by other local area networks.

FIELD

Embodiments of the invention relate to acquiring, storing, and accessingdental images.

BACKGROUND

Many images are taken at dental offices on a daily basis. Such imagescan include two-dimensional x-ray projections that are reconstructedinto three-dimensional volumetric images. These three-dimensional imagescan have a relatively large file size. As a consequence, the files areoften difficult to store and access.

SUMMARY

Internet-based cloud storage systems are widely available and offerscalability. As a consequence, data storage of x-ray images on anInternet-based cloud system has been proposed by others. However,current Internet-based cloud data storage systems have numerousdeficiencies, especially when application of such systems to a dentaloffice imaging system is considered.

Upload and download times can be problematic because numerous devicesmay be attempting to upload or download large amounts of data at thesame time. Residential and small business Internet connections oftenhave an upload speed that is slower than the download speed. Thisasymmetric characteristic is problematic because many devices (e.g.,x-ray machines) may be attempting to transmit large amounts of data tothe cloud system within the same time period. This can create abottleneck of data to be uploaded. Dentists cannot wait extended periodsof time for data to upload before taking additional images.

Additionally, a reliable connection is required at all times in order tomaintain an operational dental imaging system because if data istransmitted while the dental office is not connected to the cloud, thedata will be lost. Cloud servers may be unavailable if the cloud crashesor if the Internet connection suffers a failure.

Accordingly, in some embodiments, the invention provides systems andmethods for storing and accessing dental images in a manner designed toreduce or overcome many of the noted problems. Some embodiments of theinvention use a server on a local area network (LAN) in combination withan Internet-based cloud server to minimize upload problems created bylarge amounts of data, slow upload times, and/or unreliable Internetconnectivity. Some embodiments of the invention store specified data ona local server for quick and efficient access in the dental office.

Certain embodiments of the invention increase upload and download speedsby using modified video compression techniques. In some embodiments ofthe invention, video compression is used on a series of two-dimensional,x-ray dental images. Embodiments of the invention utilize datacompression with a modified prediction algorithm customized for x-rayimages. As discussed in greater detail below, the term “translucent” isused to describe the images processed in embodiments described hereinbecause the radiation to which the imaged object is exposed passes (atleast partially) through the imaged object and the resulting image, forexample, when produced on film, has certain translucent properties orcharacteristics.

Certain embodiments of the invention allow dental images to be accessedfrom multiple locations both inside and outside a dental office.Embodiments of the invention provide scalability and wide availabilityof cloud server data storage while also providing improved upload speed.

Certain embodiments of the invention queue data uploads on a server onthe LAN until upload to the cloud server is achieved. Thus, dentists donot need to wait for data to upload to the cloud before capturingadditional data. Certain embodiments of the invention allow queuedimages on the LAN server to be uploaded after normal business hours ifnecessary. Additionally, certain embodiments of the invention allowdentists to continue collecting data (e.g., taking x-rays) when Internetaccess fails or when a cloud service provider or component crashes or isdown, because data to be uploaded can be stored on the local serveruntil the Internet connection or cloud is restored.

Embodiments of the invention cache download requests on the LAN serveruntil they can be fulfilled by the cloud server. Some embodiments of theinvention use the same application interface supported by both the LANand cloud servers so that client software can connect to the LAN serverwhen inside the dental office or to the cloud server when outside thedental office.

In one exemplary embodiment, the invention provides a method of managingx-ray image data. The method includes acquiring the x-ray image data.The x-ray image data is associated with a first patient. The method alsoincludes storing the x-ray image data on an x-ray acquisition computer,transmitting the x-ray image data to a local server from the x-rayacquisition computer, storing the x-ray image data on the local server,transmitting the x-ray image data from the local server to a remoteserver, and storing the x-ray image data on the remote server. Themethod also includes retrieving patient appointment schedulinginformation from an electronic patient scheduling calendar. The patientappointment scheduling information includes at least one of an amount oftime elapsed since a most recent visit of the patient and an amount oftime until a next expected visit of the patient. The method alsoincludes automatically deleting the x-ray image data from the localserver when at least one condition is satisfied. The at least onecondition is based on the patient appointment scheduling information.

In another exemplary embodiment, the invention provides a system forstoring and accessing medical images. The system includes an imagingsystem configured to acquire a series of related x-ray frames associatedwith a patient. A local server is connected to the local area network.The system also includes a local server connected to the imaging systemand configured to receive the series of related x-ray frames, store theseries of related x-ray frames according to a specified policy, andtransmit the series of related x-ray images to a remote server. Thespecified policy includes deleting the x-ray frames from the localserver when at least one condition is satisfied. The at least onecondition is based on at least one of an amount of time elapsed since amost recent visit of the patient, an amount of time elapsed since a mostrecent access of data associated with the patient, an amount of timeuntil a next expected visit of the patient, and an amount of availablestorage space on the local server.

The system may also include compressing the series of related x-rayframes to create a compressed image data set, and placing the compressedimage data set in the upload queue.

The system may also include a cloud server configured to communicate tothe local server. The cloud server receives the series of related x-rayframes from the upload queue, and stores the x-ray frames. The x-rayframes may be compressed prior to transmission and storage. Thus, thecloud server may be configured to receive compressed data sets and storethe compressed data sets.

In another embodiment, the invention provides a method of storing andaccessing medical images. The method includes creating a series ofrelated x-ray image data using an imaging system. The imaging system isconnected to a local area network and the x-ray image data is associatedwith a patient. The method also includes sending the series of relatedx-ray frames from the imaging system to a local server, where the localserver is connected to the local area network. The method also includesstoring the series of related x-ray frames on the local server accordingto a specified policy; and transmitting the series of related x-rayframes outside the local area network for storage.

The method may also include compressing the series of x-ray relatedprojection frames to create a compressed image data set prior to sendingthe series of related x-ray projection frames outside the local areanetwork for storage. Alternatively, the series of related x-rayprojection frames may be compressed prior to storing the series ofrelated x-ray projection frames on the local server.

In yet another embodiment, the invention provides a system forprocessing x-ray image data. The system includes an imaging system. Theimaging system is configured to acquire x-ray image data. The x-rayimage data includes a plurality of x-ray frames, and the plurality ofx-ray frames includes first and second frames. The system also includesa codec. The codec is configured to receive the x-ray image data fromthe imaging system and compress the plurality of x-ray projection framesto generate a compressed data set by performing at least one ofcomputing a difference between the first and second frames, andpredicting at least one pixel of the second frame based on at least onepixel of the first frame.

In another embodiment, the invention provides a method of processingx-ray data. The method includes acquiring a plurality of x-rayprojection frames of at least one object representing at least a portionof a patient and compressing the plurality of x-ray projection frames togenerate a compressed data set. The plurality of x-ray projection framesincludes first and second frames. Compressing the plurality of x-rayprojection frames includes at least one of computing a differencebetween the first and second frames, and predicting at least one pixelof the second frame based on at least one pixel of the first frame.

Other aspects of the invention will become apparent by consideration ofthe detailed description and accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a block diagram of a hybrid system for storing andaccessing dental images from within a dental office or outside thedental office.

FIG. 2 illustrates a networked imaging system of the hybrid system ofFIG. 1.

FIG. 3 is a schematic diagram of a compression method implemented by thehybrid system of FIG. 1.

FIG. 4 is a schematic diagram of a compression method that compresseseach projection frame individually.

FIG. 5 is a schematic diagram of a method of uploading an image to acloud server implemented by the hybrid system of FIG. 1.

FIG. 6 is a schematic diagram of a method of downloading image data to alocal image device from the cloud server implemented by the hybridsystem of FIG. 1.

FIG. 7 is a schematic diagram of a method of downloading image data toan external device from the cloud server implemented by the hybridsystem of FIG. 1.

DETAILED DESCRIPTION

Before any embodiments of the invention are explained in detail, it isto be understood that the invention is not limited in its application tothe details of construction and the arrangement of components set forthin the following description or illustrated in the following drawings.The invention is capable of other embodiments and of being practiced orof being carried out in various ways.

FIG. 1 illustrates a hybrid system 100 for acquiring, storing andaccessing data associated with dental images using a local area network(LAN) 105 in combination with components connected to the LAN 105 via anetwork 110, for example, the Internet. Since dental offices oftenacquire several dental images associated with patients of the dentaloffice, the hybrid system 100 may be implemented in a dental office tofacilitate the storage and management of dental images associated with aplurality of patients. The hybrid system 100 allows a user to store alarge number of dental images associated with a patient by using uniquecompression techniques. The hybrid system 100 also allows a user toaccess the stored dental images inside and outside a specific dentaloffice. This may allow, for example, a patient to access his/her dentalimages even when he/she is not in the dental office using, for example,a mobile application that connects the patient to the hybrid system 100.

The hybrid system 100 includes a dental office 115 having at least onenetworked imaging system 120, at least one local image device 125, and alocal server 130. The dental office 115 also includes the LAN 105 thatconnects to the networked imaging system 120, the local image device125, and the local server 130. The local image device 125 may be, forexample, a computer running client software 140. In the illustratedembodiment, the hybrid system 100 includes a plurality of local imagedevices 125 a-d. In other embodiments, the hybrid system 100 onlyincludes a single local image device 125 a-d. The networked imagingsystem 120 and local image devices 125 a-d connect to the LAN 105 viaclient software 140. Client software 140 can receive data from the LAN105. Furthermore, client software 140 can reconstruct a series ofrelated x-ray projection frames into a three-dimensional volumetricimage. Client software 140 may also be capable of sending and receivinga series of related x-ray projection frames as well as three-dimensionalvolumetric images. The local server 130 is also connected to the LAN 105and stores information, for example, dental images associated withpatients of the dental office 115. The local server 130 communicateswith the networked imaging system 120 and the local image devices 125a-d through the LAN 105. The hybrid system 100 further includes anInternet gateway 135. The Internet gateway 135 connects the LAN 105 tothe network 110, which allows the local server 130, the networkedimaging system 120, and the local image devices 125 a-d to communicatewith the components connected to the network 110. Sometimes thecomponents connected to network 110 alone or together with the network110 are referred to as a “cloud.” The network 110 is connected to atleast one cloud server 155 and can be connected to at least one externalimage device 145 outside the dental office 115. In the illustratedembodiment, the network 110 is connected to a plurality of externalimage devices 145 a-b.

The types of devices and number of devices used in the hybrid system 100can vary in alternate embodiments. For example, although only one dentalimaging machine 200 and only one networked imaging system 120 arepictured in FIG. 1, alternate embodiments of the invention may includemultiple dental imaging machines 200 and/or multiple networked imagingsystems 120. Furthermore, in some embodiments, the hybrid system 100 caninclude at least one networked imaging system 120 or at least one localimage device 125 but not both.

As shown in FIG. 2, the networked imaging system 120 includes a dentalimaging machine 200 (e.g., an x-ray machine capable of capturing imagesfor cone beam computed tomography (“cone beam CT” or “CBCT”), forpanoramic imaging, or for cephalometric imaging) and a local imagedevice 125 a. The dental imaging machine 200 acquires x-ray image dataassociated with a patient. The x-ray image data from the imaging machinemay be, for example, in the form of a series of related x-ray projectionframes. In the illustrated embodiment, the network imaging system 120also includes a computer 122. The computer 122 controls the dentalimaging machine 200 and may run client software 140 to connect thedental imaging machine 200 to the LAN 105. In the case of cone beam CTimaging, the computer 122 processes the x-ray projection frames toproduce a three-dimensional, volumetric image of a portion of thepatient. In some embodiments, the computer 122 is also referred to as anacquisition computer. In some embodiments the local image device 125 ais referred to as a viewing computer. In the illustrated embodiment, thelocal image device 125 a is connected to the computer 122 (e.g., via USBor Firewire) to allow the series of related x-ray projection frames orthe three-dimensional volumetric image to be viewed. Although computer122 is pictured in FIG. 2, in some embodiments, the local image device125 a is connected to the dental imaging machine 200 and runs clientsoftware 140 to connect to the LAN 105. In other embodiments, the dentalimaging machine 200 runs client software 140 and connects to the LAN 105without using computer 122 or local image device 125 a. In embodimentsin which the dental imaging machine 200 includes an internalimage-processing computer (not shown) that runs client software 140 andconnects to the LAN 105 without the computer 122 or the local imagedevice 125 a, the internal image-processing computer within the dentalimaging machine 200 can be referred to as an acquisition computer.

In the illustrated embodiment, the dental imaging machine 200 isconfigured to acquire panoramic, three-dimensional, and cephalometricdental scans. The dental imaging machine 200 includes an x-ray source206, a first x-ray image detector 207, a second x-ray image detector208, and a third x-ray detector 211. In the illustrated embodiment, eachx-ray image detector 207, 208, 211 captures a different type of x-rayimage (e.g., CT image, panaromic image, or cephalometric image). Thex-ray source 206 and the first x-ray image detector 207 are mounted on agantry 202 coupled to a support arm 210 and the first x-ray imagedetector 207 is positioned directly opposite the x-ray source 206. Insome embodiments, a patient is positioned between the x-ray source 206and the first x-ray image detector 207 so that the dental imagingmachine 200 can capture an x-ray image of at least a portion of thepatient. The gantry 202 rotates about the patient. As the support arm210 rotates around the patient, the x-ray source 206 and the x-ray imagedetector 207 acquire a plurality of x-ray projection frames (commonlyreferred to as “projection frames”) of the patient. For example, thesupport arm 210 is first placed at a first angle and the x-ray source206 and the first x-ray image detector 207 acquire a first x-rayprojection frame of the patient. The support arm 210 then rotates and ispositioned at a second angle different than the first angle. The x-raysource 206 and the first x-ray image detector 207 then acquire a secondx-ray projection frame of the patient at the second angle. The x-raysource 206 and the first x-ray image detector 207 can rotate relative tothe patient and obtain a plurality of x-ray projection frames. Becauseof the rotation of the support arm 210 about the patient, the x-raysource 206 and the first x-ray image detector 207 can capture panoramicdental images. The x-ray projection frames captured by the x-ray source206 and the first x-ray image detector 207 can also be used to constructa three-dimensional model of at least a portion of the patient.

The second x-ray image detector 208 is supported by a beam 209 andpositioned opposite the x-ray source 206. The second x-ray imagedetector 208 of the dental imaging machine 200 can perform cephalometricdental scans. A screen is positioned between the x-ray source 206 andthe second x-ray image detector 208. Typically, a patient is positionedbetween the second x-ray image detector 208 and the screen. The screenis then able to control the amount of x-ray radiation reaching thepatient. For example, the screen is movable and can be positioned suchthat only the area immediate the patient's mouth receives x-rayradiation. Thus, the screen is configured to minimize the patientexposure to x-ray radiation and perform cephalometric dental scans.

The x-ray projection frames obtained through the dental imaging machine200 represent at least a portion of a patient and/or one object withinthe patient. In some embodiments, the x-ray projection frames areassociated with the same patient and are simply taken at distinct anglesrelative to the patient. In other embodiments, a first projection frameand a second projection frame may be related in a different manner. Forexample, the first frame may be taken at a first period of time and thesecond frame may be taken at a second period of time different from thefirst period of time. Because the x-ray projection frames obtained foreven just one patient often require large amounts of storage space, thehybrid system 100 uses video compression techniques to compress thex-ray image data associated with patients of the dental office 115.Examples of suitable compression algorithms include, but are not limitedto, H.264, H.265, CABAC, CAVLC, and Exp-Golomb.

The hybrid system 100 includes a modified video codec 150 to compressthe series of related x-ray projection frames according to a modifiedvideo compression technique. The modified video codec 150 can includesoftware, hardware, or a combination of software and hardware. Themodified video compression technique uses a modified inter-frameprediction algorithm. Compressing the series of related x-ray projectionframes using the inter-frame prediction algorithm increases thecompression ratio of the image data in comparison to compressing eachraw image projection frame individually. In the illustrated embodiment,the codec 150 is located in the local server 130. In other embodiments,the codec 150 is located on other parts of the hybrid system 100 (e.g.,within the acquisition computer 122 or the client software 140). Ingeneral terms, the networked imaging system 120 includes a processor,memory, and instructions, an ASIC, or other component (genericallyreferred to as a “codec”) that implements the logic and functions of themodified video codec 150.

Known digital video compression techniques use prediction algorithmsthat assume that the image data being compressed is data from areflective imaging process. For example, known prediction algorithms,assume that a series of images is from a video camera, in which visiblelight reflects off an object and the light is captured as an image on,for example, an electronic sensor. X-ray images (as compared to videoimages) are sometimes referred to as “translucent” because radiation inthe form of x-ray radiation passes (at least partially) through theimaged object. The resulting image, when produced on film, for example,has certain translucent properties or characteristics. Therefore, x-rayimages are not reflective images and the inter-frame predictionalgorithm in accordance with the invention has the benefit, for example,of compressing the image data more efficiently than a conventionalalgorithm.

In addition, certain known digital video compression techniques assumesingular (i.e., one-directional) motion about a center axis whennumerous images are taken at rotating angles around an object. However,a series of raw x-ray image projection frames introduces two-fold motionabout a center axis because x-rays produce translucent images ratherthan reflective images. For example, unlike imaging techniques in whichthe object is opaque to and/or reflective of to the incident light, anx-ray image reveals features both in front of and behind the axis ofrotation, and the features in the back move in a direction differentfrom that of the features in the front. Thus, the modified inter-frameprediction algorithm that accounts for the translucent nature of theimages and this two-fold motion further improves compression ratio byreducing the error of predictions between each raw x-ray imageprojection frame.

The modified prediction algorithm exploits the relationships betweenpixel values in sequential x-ray image projection frames. Someprojection frames are compressed as intra-coded frames (also referred toas “intra-frames” or “I-frames”) and other projection frames arecompressed as predictive frames (P-frames). I-frames are expressedindependently from any other frames and serve as a basis for P-frames toreference to increase compression ratios of the P-frames. Stated anotherway, periodic I-frames in the compressed sequence allow fordecompressing a subset of P-frames saved between multiple I-frames(i.e., details of P-frames can be determined from related I-frames). Thefirst compressed projection frame of FIG. 3 is considered an I-frame,and subsequent n projection frames can be either I-frames or P-frames.Unlike existing video compression techniques (e.g., MPEG, H.265, etc.),P-frames of the present invention include point-spread function indexes,which will be described in greater detail below.

More specifically, a pixel value from a particular projection frame(e.g., an I-frame) in the series of related x-ray projection framesrepresents the cumulative x-ray density of the material along the rayfrom the x-ray source 206 to the corresponding location on a detectorpanel. This pixel value tends to be distributed according to a transferfunction (sometimes also referred to as a “point-spread function” inimage processing) among neighboring pixels in subsequent projectionframes due to the rotation of the x-ray source 206 and detectorapparatus 207 about the object. In some embodiments, the improved,modified prediction algorithm uses a library of point-spread functionsto predict pixel values in successive image projection frames, providinga more accurate estimate than the prediction algorithms implemented incurrent video compression standards designed for reflective imagingmodalities. Transfer functions suitable for a particular image type canbe generated, for example, by a Monte Carlo simulation. In otherembodiments, only one point-spread function is used to compress thesuccessive image projection frames. The x-ray source 206 and the x-rayimage detector 207 acquire a first x-ray projection frame at a firstangle and a second x-ray projection frame at a second angle. At leastone pixel in the second x-ray projection frame is predicted based on thefirst and the second angles and the first x-ray projection frame. Thepoint-spread function with the smallest error residual is used, and itsindex within the library is stored in the compressed image data set 620,followed by an entropy-encoded error residual for the image. The moreaccurate, modified prediction algorithm results in smaller errorresidual, which allows for higher compression in the entropy-encodingstage of the compression algorithm.

FIG. 3 illustrates the modified video compression technique using themodified prediction algorithm where a series of related x-ray projectionframes is compressed. First, the dental imaging machine 200 acquires aseries of related n x-ray projection frames 605 (i.e., each imageprojection frame taken at a particular angle around a patient's jaw). Atstep 606, pixel information from a first x-ray projection frame isobtained. The first x-ray projection frame is an I-frame, since it isnot expressed based on any other frames. Optionally, at step 607, thefirst projection frame, which can for example be an I-frame, of theseries of related x-ray projection frames 605 is compressed using animage-compression algorithm. The image-compression algorithm can, forexample, be a JPEG-based or other conventional image-compressionalgorithm. Subsequent image projection frames, also referred to asP-frames, are then compressed using the modified prediction algorithmthat relates pixels in the image projection frame to be compressed withpixels in previous image projection frames (steps 610-615). Optionally,before the prediction algorithm is applied, each projection frame can beindividually compressed in the same manner as was done with the firstprojection frame. Thus, the set of projection frames can optionally becompressed in two ways, namely separately as individual images andtogether as a sequence of related images. In any case, at step 608, adifference between the first projection frame and a subsequent nprojection frame is computed. Particularly, the relation between thefirst projection frame and the subsequent n projection frame isdetermined. For example, the angle difference between the first frameand the subsequent n projection frame is calculated. At step 609, an npoint-spread function is applied to predict pixel values of thesubsequent n projection frame based on pixel information from the firstframe and the relation between the first frame and the subsequent nprojection frame. At step 610, an error residual based on the applied npoint-spread function is determined. In some embodiments, the npoint-spread function applied is stored in a library of point-spreadfunctions. In those embodiments, different point-spread functions areapplied to the first frame and the subsequent n projection frame. Atstep 611, a different point-spread function is applied if necessary. Ifmore than one point-spread function is applied, at step 612, thepoint-spread function resulting in the smallest error residual is usedto compress the subsequent n projection frame. At step 613, the errorresidual for the subsequent n projection frame is entropy encoded and anindex for the applied point-spread function with the smallest errorresidual is stored in the subsequent n projection frame, the P-frame.Then at step 614, the process, steps 608-613, is repeated for anysubsequent n frames. Once a point-spread function has been applied toall the subsequent n projection frames and the error residuals have beenencoded, at step 615, a compressed image data set 620 is createdincluding at least one I-frame and one or more P-frames.

In some embodiments, the compressed data set 620 is a single compresseddata file. The compressed data set 620 can also be a plurality of seriesof compressed image projection frames in separate compressed files.Furthermore, in some embodiments, the compressed data set 620 can beimplemented as a data-stream for transmission of a compressed series ofrelated x-ray projection frames.

The use of the modified video compression techniques to compress aseries of related x-ray image projection frames 605 results in a smalleramount of data to be transferred than individual compression of each rawprojection frame in the series. For example, FIG. 4 illustrates acompression method that does not utilize predictive video compressiontechniques. Thus, each raw projection frame in a series of related x-rayprojection frames 605 is compressed individually (step 710) withoutusing a prediction algorithm until all raw projection frames of theseries are compressed (step 715). The resulting data is a series ofcompressed projection-frame data 720 rather than the compressed imagedata set 620. Accordingly, the use of video compression techniques on aseries of related x-ray projection frames 605 results in a greatercompression ratio, particularly when the video compression techniqueutilizes the modified prediction algorithm customized for a series ofx-ray projection frames as explained above.

Moreover, the techniques of image compression for individual frames andpredictive video compression for the sequence of frames can be combined.For example, the predictive algorithm can be applied to the compressedprojection frame data 720, resulting in an even greater compressionratio than if only individual frame compression or only predictive videocompression were used.

After the series of related x-ray projection frames 605 is compressed,the hybrid system 100 transfers the compressed image data set 620between the dental imaging machine 200, the computer 122, the localimage devices 125 a-d, the local server 130, the network 110, and theexternal image devices 145 a-b. The local server 130 acts as a cacheserver that communicates with network 110. As shown in FIG. 1, network110 allows the local server 130 to communicate with the cloud server155. In some embodiments, the hybrid system 100 includes more than onecloud server 155. In the illustrated embodiment, the cloud server 155 isa remote server separate from the dental office 115. The external imagedevices 145 a-b, in turn, communicate with the cloud server 155. Thus,the hybrid system 100 allows the x-ray image data acquired by thenetworked imaging system 120 to be accessible to the local image devices125 a-d, the local server 130, the cloud server 155, and the externalimage devices 145 a-b.

Multiple local image devices 125 b, 125 c, and 125 d are able tocommunicate to the local server 130 via the LAN 105. This communicationallows for data associated with dental images to be transferred betweenlocal image devices 125 a-d of the hybrid system 100 and easily viewedfrom many local image devices 125 a-d. Local image devices 125 b, 125 c,and 125 d can be located in separate areas within the dental office 115from the networked imaging system 120. For example, local image device125 b can be located at a front desk of the dental office 115, in anoperating room of dental office 115, and/or in a personal office ofdental office 115.

A series of related x-ray projection frames 605 to be uploaded from thedental office 115 to the cloud server 155 is first uploaded to the localserver 130 via the LAN 105. In the illustrated embodiment, the localserver 130 compresses the series of related x-ray projection frames 605into the compressed image data set 620 as described above (see FIG. 3).In other embodiments, other components of the hybrid system 100 compressthe series of x-ray projection frames 605 into the compressed image dataset 620. The local server 130 continually synchronizes to the cloudserver 155. Upload requests to the cloud server 155 are queued on thelocal server 130 until upload is achieved. Download requests from thedental office 115 to the cloud server 155 are cached on the local server130 until the download requests can be fulfilled. Upload and downloadspeeds are increased by the modified video codec 150 that allows forincreased compression ratios.

All compressed image data 620 that is uploaded to the cloud server 155can also be stored on the local server 130 based on a specified policy.For example, the local server 130 can store compressed image data 620created within the last specified number of months. Alternatively, thelocal server 130 can also have a policy to store compressed image data620 created for a specified number of patients. The policy to storecompressed image data 620 on the local server 130 can also be based onpatient appointment scheduling information. The patient appointmentscheduling information can be stored, for example, in an electronicpatient scheduling calendar. The patient appointment schedulinginformation can include information about an amount of time elapsedsince the most recent visit of each patient, an amount of time until anext expected visit of each patient, and the like. Thus, the localserver 130 can have a policy to store compressed image data 620 from themost recent visit of each patient or a policy to store compressed imagedata 620 based on a next scheduled appointment of each patient. Forexample, the local server 130 can store compressed image data 620 if themost recent visit from a patient is within a specified time period,and/or the local server 130 can retrieve compressed image data 620associated with certain patients from the cloud server 155 when thosepatients have an appointment the next day. The policy to storecompressed image data 620 on the local server 130 can also be based onthe most recent access of compressed image data 620 associated with aparticular patient. For example, if compressed image data 620 for aparticular patient was accessed within a specified period of time, thelocal server 130 stores the compressed image data 620. The policy tostore compressed image data 620 can also be based on an amount ofavailable storage space on the local server 130. For example, if thelocal server 130 no longer includes available storage space, the localserver 130 may delete the oldest image data on the local server 130. Insome embodiments, the amount of available storage space overrides otherconditions of the policy, for example, the amount of time since the mostrecent visit, the amount of time until the next scheduled visit, and thelike. In other embodiments, the amount of available storage space isonly a secondary condition.

When compressed image data 620 stored on the local server 130 no longerfalls within the specified policy, the compressed image data 620 isdeleted to create availability on the local server 130 for newcompressed image data 620 that meets the specified policy. The policymay be based on a number of conditions. Each condition may be assessedindividually or in conjunction with another condition. Copies of deletedcompressed image data 620 remain stored on the cloud server 155 forlater retrieval. A policy may also be in place for determining when toretrieve compressed image data 620 from the cloud server 155. The policyfor retrieving compressed image data 620 from the cloud server 155 mayalso be based on a number of conditions including, for example, a timeperiod of a next expected visit of a patient and a specific user requestfor specific image data. For example, if a next expected visit of apatient is within a specified period of time, the local server 130retrieves the compressed image data 620 associated with that patientfrom the cloud server 155.

The speed of communication using the LAN 105 is generally significantlyfaster than the speed of communication using the network 110. However,in some cases, the LAN 105 may be difficult or expensive to scale up,and/or may not make the data as widely available as the cloud portion ofthe system 100. The specified policy allows the hybrid system 100 to beconfigured by a user to ensure that desired compressed image data 620 iseasily and quickly accessible from the local server 130. The hybridsystem 100 also provides scalability and wide availability of datathrough use of the cloud server 155. The cloud server 155 providesreliable back-up of compressed image data 620 and allows access tocompressed image data 620 from outside of the dental office 115. As isdiscussed below in more detail, in some embodiments of the invention,each series of related x-ray projection frames 605 is not compressedand, instead, uncompressed image data 605 is transferred amongcomponents of the hybrid system 100.

The hybrid system 100 also supports automatic failover between the localserver 130 and the cloud server 155. For example, if the connection tothe local server 130 malfunctions, local image devices 125 a-d andcomputer 122 can communicate directly with the network 110. For example,a local image device 125 a-d may determine whether the local server 130is malfunctioning based on, for example, an amount of time required forthe local server 130 to communicate with the local image device 125 a-d.When the local image device 125 a-d determines that the local server 130is malfunctioning, the local image device 125 a-d then transmits anyx-ray image data 605, 620, 720 directly to the cloud server 155. Thecomputer 122 and the local image devices 125 a-d can also store thex-ray image data 605, 620, 720 until the connection to the local server130 is restored. Similarly, the cloud server 155 may determine that thelocal server 130 is malfunctioning and transmit image data 605, 620, 720directly to a local image device 125 a-d. The local server 130 can alsodetermine when the connection to the cloud server 155 is malfunctioning.When the connection to the cloud server 155 is malfunctioning, the localserver 130 waits to upload/download any x-ray image data 605, 620, 720until the connection to the cloud server 155 is restored.

Additionally, both the local server 130 and the cloud server 155 supportthe same application interface. Thus, client software 140 can connect tothe local server 130 when inside the dental office 115 or can connect tothe cloud server 155 when outside the dental office 115.

External image devices 145 a and 145 b can access compressed image data620 on the cloud server 155 via the network 110 from outside the dentaloffice 115. In the illustrated embodiment, the external image devices145 a and 145 b include a second codec 152 to decompress the compressedimage data 620 received from the cloud server 155. In other embodiments,the cloud server 155 may include the second codec 152. The second codec152 works essentially the same as the codec 150 described above.Additionally, client software 140 on the external image devices 145 aand 145 b can compute a three-dimensional volumetric data set based onthe compressed image data set 620, 720.

In the embodiment shown, external image device 145 a is a laptopcomputer, and external image device 145 b is a tablet. However, externalimage devices 145 a and 145 b are not limited to a computer or tablet.Other devices capable of communicating with the network 110 can be used.Users of external image devices 145 a and 145 b can be notified when anew compressed image data set 620 of interest has been uploaded to thecloud server 155.

FIG. 5 illustrates a block diagram of the steps taken by the hybridsystem 100 to upload compressed image data 620 created from a series ofrelated x-ray projection frames 605 from the networked imaging system120 to the cloud server 155 in one exemplary embodiment. First, thedental imaging machine 200 acquires a series of related x-ray imageprojection frames 605 (step 305). If the dental imaging machine 200 isconnected to the computer 122, the x-ray projection frames 605 arestored on the computer 122 (step 307). Client software 140 on computer122 then transmits the series of related x-ray projection frames 605 tothe local server 130 via the LAN 105 (step 310). The series of relatedx-ray projection frames 605 is stored on the local server 130 (step312). Users inside the dental office 115 are then notified that theseries of related x-ray projection frames 605 is available (step 315).At this point, any of the local image devices 125 a-d can connect to thelocal server 130 and obtain the x-ray projection frames 605. The seriesof related x-ray projection frames 605 is then compressed into acompressed image data set 620 using a prediction algorithm customizedfor a series of x-ray projection frames 605 (step 317). The compressedimage data set 620 is placed in a queue to be uploaded and stored in thecloud server 155 (step 320). The compressed image data set 620 remainsin the queue until the upload is completed (step 325). After the uploadis completed, relevant users outside the office are notified that thecompressed image data set 620 is available (step 330). At this point,any of the external image devices 145 a-b can connect to the cloudserver 155 and obtain the x-ray image data 620. The hybrid system 100then retrieves the patient appointment scheduling information for thepatients associated with the hybrid system 100 (step 335). The hybridsystem 100 then verifies that the x-ray image data 605, 620, 720 storedon the local server 130 still complies with the specified policy (step340). If the x-ray image data 605, 620, 720 stored on the local server130 no longer complies with the specified policy, the x-ray image data605, 620, 720 is deleted from the local server 130 (step 345).

FIG. 6 illustrates a block diagram of exemplary steps taken by thehybrid system 100 to download compressed image data 620 to a local imagedevice 125 a-d. First, the local image device 125 a-d makes a downloadrequest for a compressed image data set 620 (step 405). The hybridsystem 100 then verifies whether the connection to the local server 130is enables (e.g., the hybrid system 100 is connected), disabled (e.g.,the hybrid system 100 is disconnected), or malfunctioning (step 406). Ifthe connection to the local server 130 is disconnected ormalfunctioning, the x-ray image data 605, 620, 720 is downloadeddirectly from the cloud server 155 to the local image device 125 a-d(step 408). If the connection to the local server 130 is workingproperly, the hybrid system 100 checks if the requested compressed imagedata set 620 is already stored on local server 130 (step 410). If therequested compressed image data set 620 is not already located on thelocal server 130, the compressed image data set 620 is downloaded fromthe cloud server 155 to the local server 130 (step 415). Next, thedownloaded compressed image data set 620 is decompressed (or restored)into a decompressed data set including a series of related x-rayprojection frames 605 according to the modified prediction algorithmcustomized for a series of x-ray projection frames 605 (step 417). Oncethe decompressed series of raw image projection frames 605 is on thelocal server 130, the decompressed (or restored) data set 605 is sentfrom the local server 130 to the local image device 125 a-d that madethe download request (step 420). In the illustrated embodiment, thelocal image device 125 a-d then reconstructs the series of related x-rayprojection frames 605, computes a three-dimensional volumetric data setbased on the series of related x-ray projection frames 605, and displaysa three-dimensional volumetric image (step 425). In additionalembodiments, the series of raw projection frames can be viewed withoutcomputing a three-dimensional volumetric data set.

FIG. 7 illustrates a block diagram of exemplary steps taken by thehybrid system 100 to download compressed image data 620 to an externalimage device 145 a-b. First, the external image device 145 a-b makes adownload request for a compressed image data set 620 (step 505). Thecompressed image data set 620 is downloaded from the cloud server 155 tothe external image device 145 a-b (step 510). The downloaded compressedimage data set 620 is decompressed into a series of related x-rayprojection frames 605 according to the modified prediction algorithmcustomized for a series of x-ray projection frames 605 (step 515).Optionally, if each frame was also previously compressed on aframe-by-frame basis, step 515 can further include frame-by-frame imagedecompression. In the illustrated embodiment, the external image device145 a-b then reconstructs the decompressed series of related x-rayframes 605 and computes a three-dimensional volumetric image data set(step 520). In additional embodiments, the series of related x-rayframes 605 can be viewed without computing a three-dimensionalvolumetric image data set.

In some embodiments, local image devices 125 a-d and/or external imagedevices 145 a-b may request a plurality of series of related x-rayprojection frames 605 and/or compressed data sets 620 associated withmultiple series of related x-ray projection frames 605. The plurality ofx-ray projection frames 605 and compressed data sets 620 requested bythe image devices 125 a-d, 145 a-b may be associated with a particularpatient (i.e., history of x-rays for a patient) and may be downloadedconcurrently.

In the embodiments described so far, the local server 130 communicatesdirectly with the network 110. In additional embodiments, numerous localservers 130 communicate with a cache server (not pictured), which, inturn, communicates with the network 110. Numerous local servers 130 canbe located at numerous dental offices 115. For example, a second localserver (not pictured) can retrieve and store a series of related x-rayprojection frames 605 and/or compressed data sets 620 from the cloudserver 155 after the local server 130 uploads the series of relatedx-ray projection frames 605 and/or compressed image data sets 620.Compressed image data sets 620 and series of related x-ray projectionframes 605 can be shared and viewed between dental offices 115.

In one embodiment, the hybrid system 100 can be located in a largefacility, for example, a hospital. The large facility can include atleast one local server 130 that communicates directly to the network110. Alternatively, each local server 130 can communicate with a cacheserver, which, in turn, communicates with the network 110.

In embodiments described so far, compression occurs before placing theimage data to be transferred in the upload queue (see step 317). Butoptionally, compression of the series of related x-ray projection frames605 (step 317) can occur at any point prior to uploading the compressedimage data set 620, 720 to the cloud server 155. Thus, compression canoccur after the series of related x-ray projection frames 605 is placedin the upload queue. Alternatively, compression can occur immediatelyafter the series of related x-ray projection frames 605 is acquired andbefore the series of related x-ray projection frames 605 is transmittedto the local server 130.

In some embodiments, each series of related x-ray projection frames 605may not be compressed before transmitting image data to the cloud server155. For example, if a series of related x-ray projection frames 605 issmall in data size, the local server 130 may transmit an uncompressedseries of related x-ray projection frames 605 to the cloud server 155 tobe stored. Accordingly, local image devices 125 a-d and external imagedevices 145 a-b may not perform decompression (steps 417 and 515respectively) when downloading the uncompressed series of related x-rayprojection frames 605 from the cloud server 155.

In embodiments described so far, storage of the series of related x-rayprojection frames 605 occurs before compressing the series of relatedx-ray projection frames 605 (see step 312). But optionally, the localserver 130 can compress the series of related x-ray projection frames605 into a compressed image data set 620, 720 and store the compresseddata set 620, 720 on the local server 130.

In some embodiments, local image devices 125 a-d include a codec inplace of or in addition to the codec 150 of the local server 130. Thus,all compression and decompression can occur on local image devices 125a-d. Accordingly, only compressed image data sets 620 are transferredwithin the hybrid system 100.

Thus, embodiments of the invention provide, among other things, systemsand methods for storing and accessing medical image data using a localserver in combination with a cloud server. The systems and methods makeuse of improved video compression techniques for use on a series ofx-ray, two-dimensional, raw projection frames. The systems and methodsallow for quick access to specified data on a local server while alsoproviding scalability and wide availability of data through use of acloud server.

Various features of the invention are set forth in the following claims.

What is claimed is:
 1. A method of processing x-ray data, the methodcomprising: acquiring a plurality of x-ray projection frames of at leastone object representing at least a portion of a patient, the pluralityof x-ray projection frames including first and second frames; andcompressing the plurality of x-ray projection frames to generate acompressed data set, wherein the compressing includes predicting atleast one pixel of the second frame based on at least one pixel of thefirst frame; providing an x-ray source and an x-ray image detector; thedetector configured to output the first and second frames; acquiring thefirst frame while the source and detector are at a first angle withrespect to the patient; and acquiring the second frame while the sourceand detector are at a second angle with respect to the patient; whereinthe first frame includes a first x-ray projection of at least one objectwithin the patient; wherein the second frame includes a second x-rayprojection of the at least one object and wherein compressing theplurality of x-ray projection frames includes using at least the firstand second angles to predict values of pixels representing the secondx-ray projection in the second frame.
 2. The method of claim 1 furthercomprising computing a three-dimensional volumetric data set from thecompressed data set.
 3. The method of claim 2, wherein computing athree-dimensional volumetric data set includes decompressing thecompressed data set to generate a decompressed data set and computingthe three-dimensional volumetric data set based on the decompressed dataset.
 4. The method of claim 1 wherein compressing the plurality of x-rayprojection frames includes processing the first frame with a pointspread function to predict the at least one pixel of the second frame.5. A system for processing x-ray image data, the system comprising: animaging system configured to acquire x-ray image data, the x-ray imagedata including a plurality of x-ray frames, the plurality of x-rayframes including first and second frames; and a codec configured toreceive the x-ray image data from the imaging system and compress theplurality of x-ray projection frames to generate a compressed data set,wherein the compressing includes predicting at least one pixel of thesecond frame based on at least one pixel of the first frame; providingan x-ray source and an x-ray image detector; the detector configured tooutput the first and second frames; acquiring the first frame while thesource and detector are at a first angle with respect to the patient;and acquiring the second frame while the source and detector are at asecond angle with respect to the patient; wherein the first frameincludes a first x-ray projection of at least one object within thepatient; wherein the second frame includes a second x-ray projection ofthe at least one object and wherein compressing the plurality of x-rayprojection frames includes using at least the first and second angles topredict values of pixels representing the second x-ray projection in thesecond frame.
 6. The system as claimed in claim 5, the system furthercomprising a computer configured to generate a three-dimensionalvolumetric data set from the compressed data set.
 7. The system of claim6, wherein the computer is configured to decompress the compressed dataset to generate a decompressed data set and compute a three-dimensionalvolumetric data set based on the decompressed data set.
 8. The system ofclaim 6, wherein the imaging system includes: an x-ray source; and anx-ray image detector, the detector configured to output the first andsecond frames, wherein the imaging system is configured to acquire thefirst frame while the source and the detector are at a first angle withrespect to the patient, and to acquire the second frame while the sourceand detector are at a second angle with respect to the patient; whereinthe first frame includes a first x-ray projection of at least one objectwithin the patient; wherein the second frame includes a second x-rayprojection of the at least one object; and wherein the codec isconfigured to compress the plurality of x-ray projection frames by usingat least the first and second angles to predict locations of pixelsrepresenting the second projection in the second frame.
 9. The system ofclaim 5, wherein the codec is configured to compress the plurality ofx-ray projection frames by processing the first frame with a pointspread function to predict the at least one pixel of the second frame.